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ABSTRACT 

The effectiveness of using computer courseware 
developed for adults reading below the fourth-grade level was 
investigated with inmates at Rockview State Correctional Institution. 
Data were collected both to establish multiple baselir.e data and to 
permit experimental group comparison with a control group. The 
multiple baselines portion of the study involved 11 male inmates witiix 
reading levels of 0-4 who completed 18-25 hours of work with the 
courseware. The Wide Range Achievement Test (WRAT) and the Slosson 
Oral Reading Test (SORT) were used as pre- and posttests. The 
courseware was considered effective. Testing 10 months later showed 
that students' retention level was about 90 percent. In the 
experimental/control group portion of the study, 27 inmates were 
tested with 2 sections of the Baltimore County Design, the Bader 
Reading and Language Inventory, the SORT, and a test of incidental 
learning of computer words. The experimental group each used the 
courseware for 10-22 hours whereas the control group received small 
group and tutorial instruction using traditional beginning materials 
for adult reading instruction but was not exposed to 
computer-assisted instruction. The 23 men who completed the work were 
given posttests using the same measures used for the pretests. 
Analysis of variance for repeated measures was used to analyze the 
test differences. The only measure that showed a statistically 
significant difference was the Bader Reading and Language Inventory. 
The control group showed no improvement on the posttest measure and 
had fallen behind the experimental group at that time, even though 
they had started out at a higher level. (Two references and three 
tables are included.) (CML) 
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Abstract 

The computer courseware thot exists for Adult Basic Education assumes at 
ieost a fourth grade reading level. Yet the greatest need for individualized 
Instruction Is at the beginning reading levels. Hence, the development of computer 
courseware designed to teach recognition of 1000 high frequency words and 
functional vocabulary was funded in the Fall, 1984 by the Pennsylvania Department 
of Education for those adults functioning in reading below a fourth grade level. 

Since the courseware development project is a product of The Pennsylvania 
State University's Institute for the Study of Adult Literacy in the College of 
Education, it seemed appropriate that the effectiveness of the courseware should be 
carefully evaluated. In July I, 1985-June 30, 1986, such an evaluation was funded by 
the Pennsylvania Department of Education, 310 Adult Basic Education Special 
Project. A rigorous evaluation of the courseware was conducted at Rockview State 
Correctional Institution near Penn State University. The objectives of this project 
were achieved; the courseware evaluation results are reported herein. 

Concurrently with the evaluation, the courseware development project was 
being continued with funds from the Pennsylvania D-^partment of Education Chapter 
I. The development process is complete as of September, 1986. During 1986-87, the 
courseware is undergoing evaluation with parents of children enrolled in Chapter I 
compensatory education programs throughout Pennsylvania. A version with 
interactive audiodisk using humnn voices Is also being developed especially for non- 
native speakers with funding from Chapter I. The results of these efforts will be 
available from Penn State University's Institute for the Study of Adult Literacy In 
Augjst, 1987. 

The courseware in the present version using a speech synthesizer Is available 
at cost from the Institute for the Study of Adult Literacy, The Pennsylvania State 
University, 203 Rockiey Building, University Park, PA 16802 (814/863-3777). 



FINAL REPORT; EVALUATION OF COMPUTER 
COURSEWARE FOR ADULT BEGINNING READING INSTRUCTION 

IN A CORRECTIONAL SETTING 

Eunice N. Askov 
Professor of Educotion 
Director* Institute for the Study of Adult Literoc/ 
The Pennsxlvonia State University 
203 Rockier Building 
University Pork, PA 16802 
814/863-3777 

INTRODUCTION 

Computer-Assisted Instruction (CAl) courseware was developed during the 
1984-86 fiscal years with funding from the Pennsy'vanIa Department of Education, 
Chapter I and 310 Adult Basic Educotion Special Projects. This courseware uses a 
"whole word" approach with some word building activities in teaching 1,000 high 
frequency and functional words to adult beginning readers. The goal is expanded 
word recognition for adult non-readers. The courseware is interactive, branching 
and responding to the user's answers and needs. The courseware runs on on Apple lie 
microcomputer with two disk drives, color monitor, printer, and a speech 
synthesizer (Echo CP). The courseware consists of 28 disks which deliver the 
instructional program and record student responses. 

The courseware begins with a module on computer usage, especially ocqainting 
the student to the speech synthesizer, the commands, and the letter/number keys. 
Reading vcccbulary has been divided into two categories: picturable end non- 
plcturoble words; these are further divided into groups oi ten words (or word sets In 
a lesson). Picturable words are introduced with c graphic while non-plcturable 
words are introduced using short selections on a variety of topics. The words are 
taught in context with multiple choice and completion exercises to practice 
recognition of the target words. Games are used to reinforce the acquisition of new 
vocabulary. 



The student Is pretested before each lesson with 90% set as moster y level. If 
mastery Is not attained, the student Is directed to the instruction and games to help 
him/her learn the vocabulary. The student is posttested upon completion. Ten 
forms of each test exist. The courseware uses branching to permit review and 
reinforcement. An elaborate record-keeping system records and analyzes responses, 
number of attempts, and response time. A file editor disk allows the instructor to 
monitor a student's progress. 

During the 1 985-86 fiscal year, the use of the courseware was evaluated at the 
Rockview State Correctional Institution. The target population consisted of mole 
prison inmates at the 0-4 reading level. Because this group hod not learned to read 
using conventional methods of teoching, a new approach seemed desirable.. The 
computer offers a novel vehicle for learning to read. Innovotive approaches hove 
been recommended by Hunter and Harmon (197?) and others In teaching reading to 
those who have many problems in addition to illiteracy. 

This project involved two phases of evaluation: a multiple baseline study and a 
group comparison study. Eoch of these will be described separately. 

MULTIPLE BASELINE STUDY 

This study used a single subject, multiple baseline design across behaviors (I.e, 
word sets). The subject and condition were held constant. Each bosellne phase 
corresponds to a different set of words being taught to the subject. 

Permanent product recording was used to Identify a baseline and show changes 
In that baseline. Two types of permanent product date were collected: the number 
of correct items In a pre-/posttest and the time to criterion (i.e., the average 
amount of time required for a correct response In a pre-/posttest). Both sets of 
data are presented graphically In order to onoiyze a subject's performance. 

This phose of the evoluatlon was conducted In the Special Education classroom 
In the education building at Rockview State Correctional Institution. Four computer 
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Stotions were set up in the room. These were arranged in pairs at opposite ends of 
the room. EocH stotion was equipped with an Apple lie microcomputer, an Echo CP 
speech synthesizer, and headphones. 

Ail of the subjects were enrolled in classes for beginning levels of reading 
instruction although none had attended any Adult Basic Educotion (ABE) classes 
outside the prison. None of the subjects had previous computer experience. 

The Wide Range Achievement Test (WRAT) had previously been administered 
to them as a port of routine prison procedure. The reading subtest and the 
composite score are, therefore, reported cis global measures of reading ability. 

The Slosson Oral Reading Test (SORT) was used as a measure of sight word 
recognition. This test consists of word lists which the subject is asked to read. The 
score is reported as a reading level. According to the technical information 
available with the SORT, this test has a rater/inter-rater reliability coefficient of 
.99. 

Three of the students spoke Spanish as their first language and English as their 
second language. The Language Assessment Battery (LAB) was used with these men. 
The LAB has parallel forms in English and Spanish; by comparing a subject's results 
on both tests, one can determine which language is stronger for that individual. 
Procedures 

Each student completed a series of introductory lessons. Following this step, 
each student was allowed to choose the three lessons which would be identified as 
his target lessons. Each target lesson began with a series of pretests which were 
administered by the microcomputer. For each lesson (word set) a thirty-item test 
was administered; by varying the order of the items, ten different forms could be 
produced. The first twenty items in each test followed a multiple choice format. 
The speech synthesizer read the sentence to the student. The student was asked to 
type the number of the words he selected. The last ten items followed a completion 



format. Again, the speech synthesizer read the sentence to the student. In these 
itenns, o word bank with the ten words taught in that lesson was provided on the 
screen as the student typed th^ missing word in the sentence. 

No feedbock was given during the test until the end of each section when a 
subject wcs told his score for thot port. At least three forms of the pretest were 
required to establish a baseline of a student's ability to read a set of words. 

Within each lesson, the words were introduced in a short selection which was 
read by the speech synthesizer. The students were allowed to hear the selection 
ogoin at any time during the lesson. A student completed the lesson at his own 
pace. After the instructional and practice sequences, a student encountered 
criterion frames which were used to assess his progress. Based on his responses to 
these criterion frames, the student was allowed to go on to the practice games or 
was recycled through ports or all of the lesson. 

A variety of games were used to practice the recognition ond spelling of the 
target words. The students could choose the games they wished to try. Following 
the games, a series of posttests were administered. Each student wos required to 
complete at least four forms of the posttest to measure his new level of 
performance. The posttests were merely different forms of the thirty-item pretest. 

The men were scheduled for sessions of one hour per day for five days per 
week for a six-week period. Although the men were to unable to attend all of the 
sessions, each completed 18-25 hours of work with the coursewor's. During the time 
the students werr; working with the courseware, the researcher or a trained assistant 
was available to answer questions. 

The data from this phase ore presented by the student. A brief description of 
each student is given, followed by three graphs showing his performance. In addition 
to plotting his scores in each pre and post intervention phose, a horizontal dotted 
line representing his mean score for each phase is also plotted. This allows a quick 
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evoluation of the changes thot occurred as a result of the intervention. These mean 
scores ore summarized in Tobies t, 2 and 3 in the Appendix. 



I 



I 



0 



Student A 

Student A was a 25 year-old black mole from an urban home. He was 
monolinguot in English and hod completed the ninth grade in school. He hod 
completed about two months of ABE classes at the prison. His WR .T reading 
subtest score was 3.0 while his composite score was 2.8. His SORT grade level score 
was 2.1. He completed 23 hours of work with the courseware. 
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Figure 2: Student A: Average Time- 
Multiple Choice Items 
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Students 

Student B was a 32 year-oid black mate from an urban home. He was 
monolingual in English and hod completed the third grade in school. He had 
completed about eight months of ABE classes at the prison. His WRAT reading 
subtest score was 3.4 while his composite score was 3.0. His SORl reading level 
score was 3.8. He completed 18 hours of work with the courseware. 
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Student C 

Student C was a 35 yeor-old white male from an urban home. He spoke 
Spanish as his home ionguage and English as a second language. According to the 
LAB, Student C's reading skills in Spanish were stronger than those in English, Using 
the Level II form of the test, he performed in the ninth stanine in Spanish and in the 
third stanine in English. He had completed the ninth grade in school. He had 
attended about four months of ABE classes at the prison. His WRAT reading 
subscore was 3.3 while his composite score was 3.5. His SORT grade level score was 
1.7. He completed 25 hours of work with the courseware. 
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Student D 

Student D was a 38 year-oid black male from an urban home. He was 
monolingual in English and had attended ten years in an ungraded school. He had 
just begun attending ABE classes in the prison. His WRAT reading subtest score was 
2A while his composite score was also 2.4. His SORT grade level was 3.4 but due to 
the amount of time he took in completing th^ reading, this score may not be viewed 
as valid. Student D had sustained an undetermined amount of brain damage as a 
result of an outomobile accident. His speech was noticeably slowed and he appeared 
to hove problems concentrating on a task. He completed 22 hours of work with the 
courseware. 
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Students 

Student E was a 57 year*oid white male from on urban home. He spoke 
Spanish as his home language and English as a second language. According to the 
LAB, Student E's reading skills in both Spanish and English were very poor. Using 
the Level 11 form of the test, he performed in the second stanine in both languages. 
He reported thut he hod not attended school os a child. He had attended ABE 
classes for about three weeks at the prison. His WRAT reading subscore was 2.1 
while his composite score w^ 2.6. His SORT grade level score was 0,9. He hod a 
moderate hearing loss but was able to use the courseware effectively if he used 
headphones. He completed 25 hours of work with the courseware. 
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Student F 

Student F was a 26 year-old white nnale from an urban home. He spoke 
Spanish as his home language and English as a second language. According to the 
LAB, Student F's reading skills in Spanish were stronger than those in English. Using 
the Lbvel II form of the test, he performed in the seventh stanine in Spanish and in 
the third stanine in English. He hod completed the ninth grade in school. He hod 
attended about three months of ABE classes at the prison. His WRAT reading 
subscore was 2.1 while his composite score was 2.3. His SORT grade level score was 
2.0. He completed 22 hours of work with the courseware. 
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Student G 

Student G was a 22 year-old male from a rural home. He was monolingual in 
English and had completed the ninth grade of a Special Education program in school. 
He had completed about one year of. ABE classes in the prison. His WRAT reading 
subtest score was 3.4 while his composite score wos 3 0. His SORT grade level score 
was 2.4. He completed 23 hours of work with the courseware. 
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Student H 

Student H was a 30 year-old black male from an urban home. He was 
monolingual in English and had completed the eleventh grade in school. He had 
completed about three months of ABE classes In the prison. His WRAT reading 
subtest score was 2.4 while his composite score was 2.5. His SORT grade level score 

« 

was O.8. He completed 25 hours of work with the courseware. 
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Student I 

Student I was a 29 year-old white mole from a rural home. He was 
monolingual in English and had completed the fifth grade in school. He had 
completed about two years of ABE closses In the prison. His WRAT reading subtest 
score was 3.3 while his composite score was 2.7. His SORT grade level score was 
2.3. He completed 25 hours of work with the courseware. 
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Student J 

Student J was a 30 year-old black male from an urban home. He was 
monolingual in English and had completed the eleventh grade in school. He had 
completed about ten months of ABE clas-ses in the prison. His WRAT reading 
subtest scort was 2.3 while his composite score was 3.1. His SORT r ode level score 
was 0.5. Due to his work schedule at the prison, he was not able to attend all of the 
scheduled sessions. In addition, Student J worked more slowly than any of the other 
subjects. For these reasons, he was unable to complete three target lessons. 
Therefore only two baselines ore reported for Student J. He completed 18 hours of 
work with the courseware. 
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Figure 28: Student J: Number of 
Correct Responses 
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Figure 30: Student J: Average Time 
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Student K 

Student K was a 23 year-old black male from an urban home. He was 
monolingual in English and had completed the tenth grade in school. He had 
attended about nineteen months of ABE classes in the prison. His WRAT reading 
subtest score was 2.7 while his composite score was also 2.7. His SORT grade level 
score was 2.2. He completed 22 hours of work with the courseware. 
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GROUP COMPARISON STUDY 
In the second phase of the evaluation, a traditional experimental-control group 
design was used. A group of twenty-seven inmates was tested using two sections of 
the Baltimore County Design (Words in Isolation and Words in a Functional Setting), 
the Bader Reading and Language inventory (an informal reading inventory), the 
Slosson Oral Reading Test and a test of incidental learning of computer words. The 
Wide Range Achievement Test scores of these men were also reviewed. The WRAT 
scores were used to verify that the experimental and control groups were equivolent 
in terms of reading skills. 

Procedure 

During this six-week phase, the men in the experimental group were assigned 
to one-hour per day sessions with the microcomputer. The courseware was moved to 
a different room in the education building where only two microcomputers were 
available. Due to prison work assignments and lock-up procedures, not all of the 
men were able to attend all of their sessions. They did use the lessons for 10-22 
hours. 

During this time, the control group received small group and tutorial 
instruction in traditional beginning materials for adult reading, instruction. The 
control group hod no exposure to the CAl lessons. 

This phase of the evaluation involved as little as possible direct interaction of 
project staff with the students. The use of the courseware was coordinoted by the 
clossroom teacher and an inmate teacher-aide. 

Following the six weeks, the remaining twenty-three men were again post- 
tested using the same measures. The pretest end posttest scores were analyzed 
using analysis of variance for repeated measures. This type of test allows a 
researcher to look at the interaction between time of measurement and treatment 
(Borg and Gail, 1983). It is used to decide whether the difference between the pre- 
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test and posttest means of the experimental group is significantly greater or less 

than the difference (gain) for the control group. 

Results 

In this study, the results of the statistical tests showed growth on all 
measures. However, the only measure which showed a statistically significant 
difference was the Bader Reading and Language Inventory. The Bader Is an 
individualized reading inventory which yields a reading grade level score. These 
grade levels were converted to a numerical value (e.g., Pre-primer level equals o, 
Primer level equals 1, first grade level equals 2, etc.). These numerical values were 
then used for statistical analysis. This measure showed remarkable change n the 
pre-/posttest scores of the experimental group. The means of these groups ore 
summarized in the following table; 

Table I: Mean Score of Pre-/Posttest on the Boder 
Pretest Mean Posttest Mean 

Experimental Group 



Control Group 



0.08 


0.92 




0.30 



A mean score of 0.07 In the pretest indicates that the experimental group was 
reading on a low pre-primer level. The posttest score of 0.92 indicates that the 
experimental group was now reading close to a primer level. While the control 
group was reading significantly better than the experimental group on the pretest 
measure, they showed no improvement on the posttest measure and hod fallen 
behind the experimental group by this time. These results are surprising as we 
would expect the greatest effect of a word recognition program to be on tests 
consisting of word lists. The greatest impact, however, was a global measure of 
reading aoility on informal reading inventory. Apparently, the subjects in this study 
were able to transfer vocabulary learned in the CAI programs to a print reading 
task. The ability to recognize words in new settings, of course, is the goal of all 
o reading instruction. This goal appears to hove been achieved in this study. 
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CONCLUSIONS 

The use of the courseware appeared to be quite successful in both studies. As 
anticipated, the multiple baseline design appears to be much more sensitive to the 
learning which took place although this growth was also apparent In the group 
comparison study. 

One observation which was made by the prison's education staff wos the level 
of interest and enthusiasm shown by the students. Most of the men attended their 
sessions regularly, often coming early hoping for a chance to work on the 
microcomputer, in interviews at the end of each phase, the most common complaint 
was that they (i.e., the students) wanted more time to work with the courseware. 

The speech synthesizer did not prove difficult for these students. Even the 
hearing-Impaired Hispanic student, 57 years old, made dramatic progress in the 
multiple baseline study. 

Students from the multiple baseline study were tested for long-term retention 
of the target words by having them read a word list. All eleven men who 
participated in the multiple baseline study were tested ten months later; the 
retention level was excellent, about 90 percent. Apparently, once the words were 
learned by CAI they were retained. 

The two studies were designed to measure the effectiveness of the courseware 
in two types of instructional settings. In the multiple baseline study project 
investigators were involved in doily monitoring of instruction. In the group 
comparison study the courseware was used naturalistically in the classroom with 
very limited monitoring and intervention from project staff. In both settings the 
courseware was used effectively with inmate aides ossuming much responsibility for 
printing student records and doing other routine tasks involved in using the 
courseware. Neither teacher would be considered a "computer expert." The 



courseware appears to be not onty feasible but also effective as on instructional tool 
within an ad* basic education classroonn. 
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